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Abstract 

In this paper, the required amount of feedback overhead for multiple-input multiple-output (MIMO) beamforming 
over time- varying channels is presented in terms of the entropy of the feedback messages. In the case that each transmit 
antenna has its own power amplifier which has individual power limit, it has been known that only phase steering 
information is necessary to form the optimal transmit beamforming vector. Since temporal correlation exists for 
wireless fading channels, one can utilize the previous reported feedback messages as prior information to efficiently 
encode the current feedback message. Thus, phase tracking information, difference between two phase steering 
information in adjacent feedback slots, is sufficient as a feedback message. We show that while the entropy of the 
phase steering information is a constant, the entropy of the phase tracking information is a function of the temporal 
correlation parameter. For the phase tracking information, upperbounds on the entropy are presented in the Gaussian 
entropy and the von-Mises entropy by using the theory on the maximum entropy distributions. Derived results can 
quantify the amount of reduction in feedback overhead of the phase tracking information over the phase steering 
information. For application perspective, the signal-to-noise ratio (SNR) gain of phase tracking beamforming over 
phase steering beamforming is evaluated by using Monte-Carlo simulation. Also we show that the derived entropies 
can determine the appropriate duration of the feedback reports with respect to the degree of the channel variation 
rates. 

I. Introduction 

Consider a multiple-input multiple-output (MIMO) time-varying wireless channel for n-th frame instance: 

y[?i] = H[n]v[n]x[n] +w[n] (1) 

where the scalar x[n] represents the transmit data symbol, the matrix H[n] represents Nr x Nt wireless channel 
with the number of receive antennas Nr and the number of transmit antennas Nt, v[n] is an Nt x 1 transmit 
beamforming vector, the vector y[n] represents received signals, and w[n] is the additive independent and identically 
distributed (i.i.d.) complex-valued noise vector with zero mean and unit variance on each of its components. Each 
entry of the channel matrix H[n] is assumed to be an i.i.d. complex Gaussian random variable (RV) with zero 
mean and unit variance. The optimal beamforming scheme in terms of maximizing the output signal-to-noise ratio 
(SNR) is known as eigenbeamforming which utilizes the dominant eigenvector of the channel matrix as a transmit 
beamforming vector and the maximum ratio combining vector at the receiver side [1|. Since the eigenvector is a 
unit norm vector (not a unit elemental power on every entry of the vector), the optimal transmit vector satisfies 
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the total power constraint which limits the sum of transmit powers less than a given constant. Utilization of the 
optimal transmit beamforming method, however, can be limited by practical constraints such as limited data rate 
feedback links J2]]-||5) and transmit power constraints imposed at the transmitter (6). 

Problem known as limited feedback communication has been an active area of research, and one of main ideas 
to cope with this problem is to use codebook-based precoding methods Q. Instead of using the channel state 
information itself for signal processing at the transmitter side, the codebook-based methods only feedback the 
indices of favorable beamforming vectors to the transmitter, which are already known to both the transmitter and 
the receiver. In recent years, there have been intensive studies on codebooks construction, such as generalized 
Lloyd-type vector quantization methods 0, and Grassmannian line packing methods |4|, [5|. 

Instead of considering the total power constraint, imposing per-antenna power constraint (PAPC) is more realistic 
in practice, since each transmit antenna has its own power amplifier which has individual power limit J6). Under 
the PAPC, it is proved that only phase steering values are necessary (without magnitude information) to form the 
optimal transmit beamforming vector, regardless of the number of receive antennas (8). This is also referred to as 
equal gain transmission (EGT), which utilizes identical power but different phase steering values across transmit 
antennas [9|. Thus we consider beamforming vector satisfying PAPC 

1 T 

V[n] = —= [ e j0o[n] e J' e i[«] ... e jQN T -i[n]y (2) 

v Nt 

where 9.i[n] denotes the phase steering value of the z-th transmit antenna fT0ll - lfT4l . The optimal phase steering 
values in terms of maximizing the output SNR are determined by 

8[n] — argmax||H[n]v[n]|| 2 (3) 

9i[n] 

where 0[n] is the optimal phase steering vector defined as 

0[n] = [0 6x[n] ■■■ NT -i[n]\, (4) 

Without loss of generality 9q [n] is set to zero since the optimal vector is derived from the Frobenius norm operation 
as in ((3J. Uniform quantization on each phase steering value is proposed for multiple-input single-output systems 
in ifTUl under the assumption that 0j[n]'s are statistically independent and uniformly distributed over [— 7T, tt). 
In (9), EGT is associated with different types of receiver combining schemes which achieve full diversity order 
for MIMO systems, and an algorithm is proposed to construct codebooks including predetermined quantized equal 
gain beamforming vectors. The optimal beamforming vector cannot be determined in a closed-form due to the 
non-convexity of the problem except for some special cases flT| . In ifTTl . fl2l . algorithms to find sub-optimal 
solution for equal gain beamforming vectors are proposed for MIMO systems with arbitrary number of transmit 
and receive antennas. Construction methods for EGT codebook with PAPC are proposed by using random search 
algorithms [ 1 3 1 or combinatorial number theory iTPfl . 

Most of prior works assume block fading channel models, where channel coefficients remain constant for certain 
amount of time duration and change independently in time to the previous one (TJ. In practice, however, since 
temporal correlation exists between adjacent channel coefficients for wireless fading channels, one can utilize the 
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previous reported feedback messages as prior information to efficiently encode current feedback message. For 
Rayleigh fading channels, the correlation coefficient is given by 

p = E{h l3 [n]K 3 [n - 1]} = Jo(2irf N ) (5) 

where hij[n] represents an (z, j)-th entry of H[n], Jo(-) is the zero-th order Bessel function of the first kind, and 
/jv denotes the normalized Doppler frequency (NDF) [15|. The NDF is defined as fx — fD,maxT where fr>,max is 
the maximum Doppler frequency and r is the frame slot duration between hij[n] and hij[n— 1]. Hence, considering 
temporal correlation property of fading channels, we can adopt time evolution channel generation model as 

hi,j[n] = phi t j[n - 1] + p c Uij (6) 

where p c = \fl — p 2 , and time evolution term Uj,/s are i.i.d. complex Gaussian RV's with zero mean and unit 
variance. By exploiting the characteristics of temporal correlation, differential encoding schemes are applied to track 
time-varying channel coefficient |[T6l and to track Givens parameters for orthogonal frequency division multiplexing 
(OFDM) systems lfT71 - lfT9l . More recently, the time-varying channel is modeled by finite-state Markov chain and 
analytical results including information rate, bit rate, and effect of feedback delay are presented with the proposal of 
an algorithm for compressing CSI feedback [20|. In |21|-[22|, codebook switching schemes are proposed to adapt 
changes in channel distributions. Localized codebook sets based on chordal distance are also utilized to reduce 
signaling overhead, where feedback index is chosen only from the subset of neighboring codewords from the one 
at previous time slot |23|. In [24|-[25|, subspaces of channels are recursively fed back to the transmitter by using a 
simple gradient approach. Subspace tracking is further investigated by analyzing the geodesic trajectory connecting 
two subspaces located in adjacent time instances ll26l . Similar attempts have been made and the performance is 
evaluated using real data and channel measurements l27ll . (28). 

In this paper, we consider EGT (which is optimal under PAPC) for MIMO beamforming to obtain diversity and 
beamforming gains over time-varying fading channels. The optimal phase steering information for each antenna is 
chosen by (f3]i based on the coefficients in H[n] at the receiver side. Then, the phase steering information is encoded 
as a feedback messages, and reported to the limited feedback link. Due to the temporal correlation property of the 
fading channels, to efficiently reduce the amount of feedback overhead, differential encoding can be applied to the 
phase steering values from adjacent time instances. We define the phase tracking vector as 

e[n] = 0[n] - 0[n - 1] mod 2tt. (7) 

Unlike the uniformity in the distribution of the phase steering vector (0]i as in Fig.[T}a), the distribution of the phase 
tracking vector (0 is not uniform as shown in Fig. \Hb). Temporal correlation causes the non-uniformity in the 
distribution, and it can result that the entropy of the phase tracking vector is smaller than the phase steering vector. 
Since the entropy determines the required amount of bits to convey the corresponding information, the required 
feedback overhead of phase tracking beamforming can be represented by the entropy of the phase tracking vector. 
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Fig. 1. Joint distributions for the elements of (a) phase steering vector, and (b) phase tracking vector (Nt = 3 and /jv = 0.1) 

From we obtain 

ft(e[n]) = f(p[n]\0[n-i\) 

= He[n}) - I(6[n];0[n- 1]) (8) 

< m*\) 

where h(-) and /(•) respectively denote the continuous entropy function and the mutual information (MI) function. 
Equation (O shows that the continuous entropy is reduced by using differentially encoded feedback messages, and 
the amount of reduction is equal to the mutual information of 9[n] and 0[n — 1]. For an extreme example, in the 
case of static channel environment (channel coefficients are constant in time, i.e., p = 1), the required number of 
bits for feedback messages with differential encoding is zero, since the phase steering values are also constant in 
time. For another extreme case of random channel environment (channel coefficients in adjacent feedback slots are 
independent RV's, i.e., p = 0), the required number of bits for feedback messages with differential encoding is 
identical to the case of coherent encoding, since the phase steering values of a previous time instance give no prior 
information to the current values. The key objective of this paper is to derive the amount of required feedback 
messages for both coherent and differential encoding in the function of the temporal correlation parameter between 
adjacent time instances over time-varying channels. 

Organization: This paper is organized as follows. In Section II, statistical characteristics of feedback messages are 
investigated. For the phase steering value, exact distribution and entropies are presented. The phase tracking value 
is represented as a function of RV's whose distributions are derived. However, obtaining the exact distribution and 
corresponding entropies requires exceedingly complicated probabilistic computations and can not be represented as 
closed-form expressions. Thus in Section III, upperbounds of entropies of the phase tacking value are derived based 
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on the theory on the maximum entropy distributions. The derived entropy results are transformed to the amount 
of feedback overhead for two types of feedback messages, and the amount of reduction in feedback overhead over 
temporally correlated channels is presented in Section IV. In Section V, derived results are jointly compared to the 
Monte-Carlo simulation results, and suggestions of applications for phase tracking codebook and determination of 
feedback duration are proposed with some numerical results. Finally, this paper is concluded in Section VI. 

Notations and assumptions: Matrices and vectors are denoted as uppercase and lowercase boldface letters, 
respectively. The transpose is represented by the superscript T and the Hermitian transposition is designated by 
the superscript H . We use Frobenius norm operator || • || 2 to obtain the sum of powers of elements in matrices or 
vectors. A mod B denote that A modulor B. For a complex variable x, Z-{x) represents the angle of x; 3?, and 3 
respectively denote the real, and imaginary component of x. The a-th order Bessel and modified Bessel functions 
of the first kind are respectively denoted as J a (-) and I a {-)- For statistics, E{-} stands for expectation and f x ( ) 
denotes the probability distribution function (PDF) of RV x. The distribution equality is written as X = Y when 
the PDF's of X and Y are identical. Continuous and discrete entropy is defined as h(-) and H(-), respectively. 

II. Statistical Characteristics of Feedback Messages 
A. Phase Steering Information 

The objective function in (O is written as 

Nt-1 

||H[n]vH| 2 = ||h [n]+ Hn]e^\\ 2 

i=l 

= Hh^M + h^nle^^H 2 (9) 
where h/[n] denotes Z-th column vector of channel matrix H[n], and 

Nt—1 

h ltC [n] = ho[n] + Yl Hn]e i6i{n] . (10) 
For given 6i [n] 's with i ^ Z, the optimal phase steering value of Z-th antenna is obtained as 

6i[n] = argmax||h /iC [n] +h l [n}e 3X \\ 2 

= argmax{||h ; , c [n]|| 2 + ||h / [n]|| 2 + 25R{h^[n]h i [n]e^M } | 

= Z (hf [n]h, |C [n]) . (11) 

Following lemma and theorem provide exact distribution and corresponding entropy for phase steering informa- 
tion. 

Lemma 1: Phase steering values are i.i.d. uniform RV's over [—%, tt). 

Proof: Let us define the set of antenna indices / = {{} for all integer i satisfying 1 < i < Nt — 1 and 
i I. Prior to the proof, we note that 1) h(6i[n]\6i € j[n]) < h(8i[n]) always holds due to the fact that conditioning 
reduces entropy, 2) h(6i[n]) < log 2 2tt since which is the maximum achievable entropy among all possible PDF's 
of 6i[n] € [— 7r, tt). (Uniformity) For given ie j[n]'s, hj[n] and h; iC [n] become statistically independent complex 
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Gaussian random vectors. Thus 9i[n] is uniformly distributed over [— tt, it) for given 6^ e /[?i]'s. (Independency) 
Hence we have /i(0;[n]|0j 6 j[n]) = log 2 2tt which is known as the maximum continuous entropy for all RV's 
distributed in [— ir, ir). Thus /i(0;[ri]|0i£j[n]) < h(8i[n]) holds with equality, which represents the independency 
between 6i[n] and 6>i e /[n]'s. ■ 
Theorem 1: Continuous entropy of the phase steering value and the phase steering vector respectively become 
h(6i[ri\) = log 2 2tt and h[6[n}) = (N T - 1) log 2 2vr. 

Proof: From the uniformity and independency among phase steering values shown in Lemma [7] the entropy 
of the phase steering value becomes h(9i[n]) = log 2 2ir and the entropy of the phase steering vector becomes 
mn\) = ElY 1 h{6l[n\) = (N T - 1) log 2 2tt. ■ 

B. Phase Tracking Information 

Considering the channel generation model in ([6), we let 

h/[n] = phi[n - 1] + p c u t (12) 

hi,cN = ph ; , c [n - 1] + p c u /jC (13) 

where the elements in u; are i.i.d. complex Gaussian RV's with zero mean and unit variance and the elements in 
u/ c are identical but with variance of Nt — 1 (the variance of elements in h/ c [n — 1]). Then, (fTTb becomes 

9i[n] = Zfahf 1 [n - l]+p c uf)(pln, c [n - l]+p c u /iC ) . (14) 

Let us further define 

ai = hf 1 [n - l]h /:C [n - 1], a 2 = hf [n - l]u /jC , 

TT TT ^ ^ ) 

a 3 = u, hi tC [n - 1], a 4 = u, u /jC , 

where a/s are the sums of products of two Gaussian RV's, which are assumed to be i.i.d. zero mean complex 
Gaussian RV's from the central limit theorem for large Nr (the discrepancy arising from this assumption is shown 
to be minimal even for Nr = 2 using numerical results). We can rewrite (fT~4T > as 

9i[n] = Z(p 2 ai + p c p(a 2 + a 3 ) + p\ct±) 

= zfe^["- 1 ] + ^(a 2 + «3) + ^a 4 ) 

(a) v p\ai\ pm\ ) 

= z(e j8 <t n -y +7e J '^ (16) 

where (a) follows from the fact that Za>i represents 9i [n — 1] as shown in (fTTT l; 7 and (f> are respectively defined as 

2 

the magnitude and the phase of ^h-(ct!2 + 0-3) + #^ 04, Considering relation in (0, the tracking value of Z-th 
antenna (for notational convenience, ei [n] is denoted by e) is given as 

e = /{(e^™- 1 ! + 7e ^)e~ J < M "- 11 } 
= Z(l + 7 e^) (17) 

where i/j = <f> — 9i[n — 1]. We define 7e : '^ as the feedback overhead generator (FOG). 
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Proposition 1: The phase of FOG is a uniformly distributed RV over [— tt, tt). 

Proof: Under the assumption that a/s are i.i.d. zero mean complex Gaussian RV's, the phase <f> in ( fT6] l is 
uniformly distributed over [— tt, tt) and statistically independent to Za^ since it is formed by a weighted sum of 
«2, and «4. Thus the phase of FOG ip — <fi — 61 [n — 1] is also uniformly distributed over [— tt, 7r) due to the 
fact that Zai =9i[n-l]. ■ 
Proposition 2: The distribution of the magnitude of FOG is given by 

2kx 



(1 + kx 2 ) 2 



where k — jzr^- 

Proof: Under the assumption that a^'s are i.i.d. zero mean complex Gaussian RV's, we have the following 
distribution equality from ( TToT ) 



where X = Y denotes that the PDF's of X and Y are identical; a$ is a newly defined zero mean complex Gaussian 
RV which is i.i.d. to ,...,4}- Thus 7 2 is the ratio of two exponential RV's. Since the ratio of two i.i.d. exponential 
RV's has a probability density function (PDF) of (1 + x)~ 2 , the PDF of j 2 is derived as f^{x) = k(l + kx)~ 2 

4 

where k = x p _ pl . Hence the PDF of 7, the ratio of two Rayleigh RV's, is immediately obtained from f^.\x) as 
f 7 (x) = 2kx(l + kx 2 )- 2 . m 
Obtaining exact distribution and corresponding entropy of the phase tracking value seems mathematically intractable. 
By exploiting the statistical characteristics given in Propositions 1 and 2, we derive analytical upperbounds on the 
entropy of the phase tracking value in the following section. 

III. Upperbounds on Continuous Entropy of Phase Tracking Information 

Derivation of continuous entropy of the phase tracking value requires corresponding PDF which is not known. In 
order to present upperbounds on continuous entropy, theory on maximum entropy distributions is firstly reviewed 
with following three representative cases. 

• Gaussian Distribution: For given variance a 2 , the continuous entropy is maximized when a RV G has the 
Gaussian PDF 

Jg{x) 



V^tTo 2 

where p and a 2 respectively denote the mean and variance of the RV G. The continuous entropy of the 
Gaussian PDF is given by 



h(G) = log 2 V27recr 2 . 

Uniform Distribution: For given interval [a, b], the continuous entropy is maximized when a RV U follows 
the uniform PDF 

M*) = TT~~a 
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for a < x <b, and zero otherwise. The continuous entropy of the uniform PDF is known as 

h(U)=log 2 \b-a\. 

• von-Mises Distribution: For a circular RV with given concentration parameter k, the continuous entropy is 
maximized when a RV V follows the von-Mises PDF 

Mx',fi,K) = — * e ««»(*-A) (19) 
27t/ (k) 

where p, is a mean direction of V. Note that /2 e [— 7r, 7r) and « > 0. The corresponding mean resultant 
length (MRL) is written as 

R=Tn- A W- (20) 

For the von-Mises PDF, the continuous entropy is given by 

h(V) = -KR\og 2 e + log 2 (27rJo(/t)). (21) 

Now we are ready to utilize one of above PDFs to derive upperbounds of the exact entropy for the phase tracking 
value based on the maximum entropy theory. In Subsection A, we first use the Gaussian PDF to obtain upperbounds 
in mathematically compact expressions. In Subsection B, we derive tighter upperbounds by using the von-Mises 
PDF, followed by the asymptotic analysis on the derived results to provide insights on the behavior of the phase 
tracking value in Subsection C. 

A. Upperbound Using Gaussian PDF 

From the theory on maximum entropy distributions, the upperbound on continuous entropy can be derived based 
on the assumption that the phase tracking value has the Gaussian PDF with given variance. The variance of the 
phase tracking value is calculated from 



poo 

r 2 _ / J2 



ai{l = y)f 1 {y)dy (22) 



o 



where a 2 (7) is the conditional variance of e for given 7, and the PDF of the magnitude of FOG / 7 (y) is given in 
Proposition [2] 



Theorem 2: The continuous entropy of the phase tracking value is upperbounded by log 2 y / 2irea^=hG(e; of). 
Proof: It is an immediate consequence of the fact that the Gaussian PDF has the maximum continuous entropy 
for given variance. ■ 

However the exact calculation of ( 1221 requires exceedingly complicated probabilistic computations, and can not 
be written in a closed-form expression as well as the derived upperbound in Theorem |2] Note that the Gaussian 



entropy log 2 Vinea 2 is monotonic increasing function with respect to the corresponding variance a 2 . Hence, instead 
of using the exact value of of, we use an upperbound of it which can be written in a closed-form. 
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Lemma 2: Conditional variance of e for given 7 is upperbounded as 

1 



1, for < 7 < 1 



^(7) < { 

7r 2 /3, otherwise. 

Proof: From ( fT7] i, \e\ is equal to j^l for 7 = 00 and less than \ip\ otherwise, and thus of < = ^- holds. 
For 7 < 1, the phase tracking value can be written as 

e = tan- f . (23) 

\ 1 + 7 cos l/) / 

Since it is known that | tan -1 x\ < \x\, the variance of e for given 7 is upperbounded by 



27r J_ n \1 + 7COS'0 

' 1 (24) 



for 7 < 1. 

By using Lemma ]2\ the upperbound on a 2 t is derived as 



1 / 1 \ ^2 /-oo 

-L \ „ , n , 7T 



suih" 1 ^-^— (25) 



y {l + k) 3 ~ ' 3 + 3/c 
and the corresponding closed-form upperbound based on the Gaussian PDF is obtained as follows. 

Theorem 3: The continuous entropy of the phase tracking value h(e) and its upperbound /iG(e;cr 2 ) are further 



upperbounded by log 2 \J1-Keo\=hG{t\ c 2 ). 

Proof: In Theorem [2] it is proved that log 2 ^/l-neol upperbounds the continuous entropy of the phase tracking 
value. Since log 2 (-) is a monotonic increasing function and a\ < a\, we have the desired inequality log 2 \/2ireo~'j < 
log 2 v^eof • ■ 

B. Upperbound Using Von-Mises PDF 

Note that the phase tracking value e is a RV distributed over angular domain [— tt, tt). Hence, we can apply 
directional statistics to analyze the characteristics of e. Let x be a directional data which has a value in the angular 
domain [—tt, tt). We further define C x — E{cosx} and S x = E{sinx}. Then, the MRL and the mean direction 



are respectively defined as R x = y/C% + S% and p x — arctan (S x /C x ) to characterize the angular data x 1 30 1 . 
From the definition of the phase tracking value in ( fTTI ). let 

ve 3 ^ = 1 + 'yejip 

= 1+7 cos ip + J7 sin -0, 
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Fig. 2. (a) Conditional variance of e for given 7 obtained from Monte-Carlo simulation is compared with its corresponding upperbound. (b) 
Comparison of exact curve for C e (7) in |27) and its lowerbounds: C Ll (7) for < 7 < 1 in (70) and Cl 2 (7) for 7 > 1 in {74). 



then we can obtain v = \/l + 7 2 + 27 cos ^. Thus we have cos e = 1+7 cos t 

V ' If ^1+72+27 COS)/- 

Taking expectation of sin e, we obtain 

S £ = £{sine} = E{ 



and sine = 



7 sin tp 



cos i/j 



7sin^ 



1 



+ 7 2 + 27COS V> 
7 sin^ 



} 



2tt ^1 + 7 2 + 27C0S?A 



= 

where the last equality comes from the fact that 

7sin , 



yjl + 7 2 + 27 COSIp 



^p—x 



i/l + 7 2 + 27 cos?/' 



tp=—x 



Hence the MRL and the mean direction for e are respectively given as R e = \C e \, and ^ c = 0. 
To derive C e , we first obtain the conditional expectation for given 7 as 

1+7 cos ip 



C 6 ( 7 ) =£{cose| 7 } = £ 



1 

2^ 
fs(7) 



+ 7 2 + 27 cos V> 
1 + 7 cos i/ 1 



7 



7T + 7 2 + 27 cos -0 
for < 7 < 1 



dtp 



where 5(7) is defined as 



ff(7) 



(7 " 1)E 



3(7), otherwise 
-47 



( 7 -l) s 



+ (7 + 



-47 



(26) 



(27) 



(28) 
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with the aid of the complete elliptic integral of the first kind function Ek and the second kind function Ee ll3Tl . 
The expectation over 7 requires to calculate 



C c = / C e (x)f y (x)dx. (29) 
Jo 

For the following theorem, we assume that C e > 0, and thus R t — C e is satisfied (It will be proved in Proposition 
0. 

Theorem 4: Let the inverse function of (120b as A^ 1 (R C ) = n t , then the continuous entropy of the phase tracking 
value is upperbounded by — n t R t log 2 e + \og 2 (2-Klo(n e ))=hv(e; Re)- 

Proof: It is an immediate consequence of the fact that von-Mises PDF has the maximum continuous entropy 
of angular data for given concentration parameter. ■ 

However, d29b can not be represented in a closed-form expression. Note that the continuous entropy of the von- 
Mises PDF is inversely proportional to the corresponding MRL R e (See Appendix A). Thus we derive a closed-form 
upperbound on the continuous entropy of the phase tracking value by considering a closed-form lowerbound of R e , 
equivalently a lowerbound of C e due to R t — C e (It will be proved in Proposition^. 

Lemma 3: The conditional expectation C e (^) is lowerbounded as 

1-y = C Ll (l), for0< 7 < 1 

Proof: See Appendix B. ■ 
By using the lowerbounds 6^1(7) and Cl 2 {i), we obtain the lowerbound of C £ as 

/>1 />oo 

C e > y C Ll {x)f 1 {x)dx + J C L2 (x)f 7 (x)dx (31) 



=ci(fe) =c 2 (fc) 

where 

aW _l_ _1_ (32) 



2(1 + k) 2k 
Vk(l - k) (tt - 2tan~ 1 \fk 



c 2( fc ) = 0/1 I F\9 1" r, n~v> ln 



4A- 



2(1 + fc) 2 (l + /s) 2 V! + fc 



{21n(V*( 1 + *)-*) + k + 1 - v/^l+l)} - 



(33) 



(1 + k) 2 I V v v y J v y y J y (l + fc)3' 

Proposition 3: (a) (7 e has a non-negative value, (b) R e — C e is satisfied, and (c) the MRL R € is lowerbounded 
by ci(fc) + c 2 (k)^R L . 

Proof: (a) The integration values in OTb are non-negative, i.e., ci(fc) > and 02(h) > (See Appendix C). 
Thus, from the inequality in OTb . we have C e > c\(k) + C2(k)>0. (b) Since S e = as shown in (|26] >. the MRL is 



derived as i? £ = \/C 2 + S* 2 = C e . (c) Hence we have the lowerbound on the MRL as R e > c\(k) + 02(h) due to 
the inequality in ( f3Tb and the relation of R e = C e . ■ 
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Theorem 5: Let A~ 1 (Rl) = Kl, then the continuous entropy of the phase tracking value h(e) and its upperbound 
h(e; R e ) are further upperbounded by — k^Rl log 2 e + log 2 (27rio(KL))— hy (e; Rl)- 

Proof: The continuous entropy of the von-Mises PDF is inversely proportional to the corresponding MRL (See 
Appendix A). Proof completes by noting that R e > Rl as proved in Proposition^} ■ 



C. Asymptotic Behavior of the Derived Upperbounds 

Since four upperbounds on the continuous entropy of the phase tracking value have been derived based on the 
assumption that the corresponding PDF is the Gaussian PDF or the von-Mises PDF. Two of them in Theorem \3} 
and Theorem \5} are closed-form expressions though which are respectively looser than the corresponding numerical 
bounds in Theorem]2}and Theorem]?} In this subsection, we present the asymptotic behavior of the exact continuous 
entropy of the phase tracking value along with the derived closed-form upperbounds. Then, the asymptotic tightness 
are discussed by comparing the derived closed-form upperbounds and the exact one. 

1) Exact Entropy: Since lim p _j.i 7 = and lim p ^o 7 = 00 from the distribution equality in (fT8l . the phase 
tracking value becomes 

lime = Z(l + 7e"h = 0, (34) 

p-H 

lim e = Z(l + 7 e"h = ip. (35) 
p— >o 



Thus we have 



lim hie) — —00 (36) 



the continuous entropy of a constant value, and 

lim Me) = log 2 2vr (37) 

p— >o 

the continuous entropy of a uniform RV distributed over [—%, ir). 

2) Gaussian Upperbound in Theorem^} The upperbound on the variance of the phase tracking value in (l25l is 
asymptotically written as 



r 2 



limcr.^ = lim o?. = lim — - + lim \ \ — — - sinh Vfc = 0, (38) 

P-H (a) fc^oo U fc^oo 3 + 3k fc^oo V (1 + k) 3 



7T 2 / k r- IT 2 

lim crl — lim — lim — + lim \ / — — sinh~Vfc = — , (39) 

P^O U (a) u k^Q 3 + 3fc k^Q V (1 + k) 3 3 



where (a) follows from the relation k — j^-pc- By the definition of /ig( £ ; c«) = log 2 \J Zirea 2 , we have 

lim h G (e;al) = -00, (40) 
1 2e7r 3 

lim/i G (e;<) = ^log 2 -r-. (41) 

p->o 2 3 
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3) von-Mises Upperbound in Theorem\5\ From d32|l-(l33T>, we recognize that 



lim ci(fc) = 1, lim ci(jfe) = 0, (42) 

lim c 2 (k) = 0, lim c 2 (fc) = 0. (43) 
Thus the lowerbound on the MRL is asymptotically given as 

lim R L = lim {ci(fc) + ci(fc)} = 1, (44) 

p— >-l (a) fc— !-oo 

lim i? L = lim {ci(fc) + ci(fc)} = 0, (45) 

P^O (a) fc-S-0 

4 — — 

where (a) follows from k = Y p _ pl . Note that kl = A^ 1 {Rl) becomes infinity as Rl goes to one. According to 
QUI , the von-Mises PDF has a limiting behavior for large kl as the Gaussian PDF 

1 (x-p) 2 

lim f v (x;p,n L ) = - — e ^ (46) 



KI,-Kx> 



71" (7 



^-2 



where tr 2 = 1/kl which approaches to zero as Ki goes to infinity. The corresponding continuous entropy is written 

as 



2ire 

lim /iy(e; Rl) = lim hvi^Rh)— lim log 2 \ = — oo. (47) 

On the other hand, kl = A~ 1 (Rl) becomes zero as Rl goes to zero. Also from ll30l . the von-Mises PDF has a 
limiting behavior for small kl as the uniform PDF 

lim f v (x;p,,K) = — (48) 

KL— >0 ZTT 

for x € [— 7r, 7r) and zero otherwise. The corresponding continuous entropy is given by 

lim h v (e;R L ) = lim hv(e\Ri) = lim h v (e; jfa,) = log 2 27r. (49) 

p^0 -Rt^O (Si->0 

4) Asymptotic tightness of the Derived Upperbounds: As p goes to zero, we found that 

1 2c7T^ 1 &7T 

lim {/i G (e; cr„) - h(e)} = - log 2 — log 2 2tt = - log 2 — , (50) 

p->0 is 2 b 

lim {/i v (e;i? L ) -h(e)} = 0. (51) 

p-s-0 1 ' 

In other words, the von-Mises upperbound is asymptotically tight for sufficiently fast-varying channels, while the 
Gaussian upperbound has the constant gap. The asymptotical tightness of the derived upperbounds for sufficiently 
slow-varying channels, however, is hard to show since both of derived ones and the exact continuous entropy 
approach to negative infinity as p goes to one. Let us denote H{X) be the discrete version of h(X). Then we can 
say that 

lim H(e)=0 (52) 

p-H 

since Pr e (X) = 8(X) holds in the case of (f34|. Also Pr £ (X) = 5(X) holds both for the Gaussian PDF with zero 
variance d38l and the von-Mises PDF with unit MRL (144-b . Thus, we can obtain 

lim H G (e;a 2 u ) = 0, (53) 

lim H v (e;R L ) = 0, (54) 
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and the asymptotic tightness of the discrete entropy of the derived upperbounds are shown as 

]im {H G (e;a 2 u )~H(e)} = 0, (55) 
\im{H v {e;R L )-H(e)} = 0. (56) 

IV. Analysis of Feedback Overhead 

A. Entropy and Feedback Overhead 

For MIMO beamforming under PAPC, a transmitter requires the phase steering vector 9[n] to make the beam- 
forming vector v[n] in Since the entropy determines the required amount of bits to convey the corresponding 
information, feedback overhead for MIMO beamforming can be represented by the entropy of the phase steering 
vector. Considering temporal correlation of fading channels, the phase tracking vector e[n] is sufficient to form 
the beamforming vector v[n] based on the definition in (Q assuming that the transmitter has prior information of 
0[n — 1]. Thus the entropy of the phase tracking vector becomes the required amount of feedback overhead when 
temporal correlation is taken into account to the encoding of feedback messages. The entropy of the phase steering 
vector is written as 

fi(0[n]) = (iV T -l)log 2 27r (57) 
due to Theorem Q] On the other hand, the entropy of the phase tracking vector is upperbounded as 

He[n}) < (N T - l)h(e) (58) 

since the elements in the phase tracking vector may statistically correlated each other. Note that we have presented 
the upperbounds on h(e) based on the theory of the maximum entropy distributions in Section IV. 

In practical systems, feedback messages should be quantized to be delivered through limited feedback links. It 
is known [29 1 that h(X) — > H(X) + log 2 A as A —> where the gap between two adjacent quantization levels 
is denoted by A. Let H[9^[n\^ and i?(e( L '[n]) respectively denote the discrete entropies of the phase steering 
vector and the phase tracking vector where the elements of each vector are uniformly quantized into L-levels. Since 
the phase steering values are i.i.d. uniform RV's, the discrete entropy of the phase steering vector is written as 

ff(0 (£) W) =(JV T -l)log a L. (59) 

The discrete entropy of the phase tracking vector is approximately upperbounded as 

ff(eW[n]) < (N T - 1) (h(e) - log 2 ^ (60) 

where j§ becomes < for sufficiently large L. 

B. Mutual Information and Amount of Reduction in Feedback Overhead 

From (O, we know that l(0[n\, 0[n — 1]) = H0[ri\) — h(e[n\) which represents the amount of reduction in 
feedback overhead for MIMO beamforming obtained from the temporal correlation property of fading channels. 
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Let /(0( L )[n];0( L V - 1]) also be the element -wise L-level uniform quantization version of l(0[n]:0[n — 1]), 
then from (29l we have l(0^ L \n\; 0^ L '[n — 1]) ~ I(0\ri\\ 0[n — 1]) where the approximation becomes accurate for 
sufficiently large L. 

• Lowerbounds on MI with the Derived Results: The MI between 0[n] and 0[n — 1] is lowerbounded as 

I(0[n};0[n-1]) > (N T - 1) (log 2 2tt - h(e)) 

(a) 

> (iV T -l)(log 2 27r-Me)) (61) 

(b) 



where the inequality in (a) comes from the inequality in ( 1581 1: h u (e) in (b) represents one of the derived 
upperbounds on the continuous entropy of the phase tracking value in the previous section, namely /i(?(e; of), 
/j G (e;of), h v (e;R e ), and h v (e;R L ). 

Asymptotic Behavior of MI: For sufficiently slow-varying channels, the MI between 0[n] and 9[n— 1] becomes 

w li: 

(a) p- 



limJ(0[nl;0[n-ll) w lim i(0 (L) [n]; (i) [n - 1] 

ff(0( L >[n]) - limif(e( L )[n]) 



(b) v / p^l 

= (N T -l)log 2 L (62) 

where the approximation in (a) becomes accurate for large L; (b) follows from the fact that H{0^ L \n\) = 
(Nt — 1) log 2 L which is not a function of temporal correlation parameter p; (c) follows from the fact that 
H(e( L '[n]) goes to zero as p — > 1 as shown in d52l ). On the otherhand, for sufficiently fast-varying channels, 
the MI becomes 



lim 1(0 [n];0[n - 

p— >o 


(a) 


/<eH) 


— lim ftfefnl) 

p-s-0 




W 




- lim H0[n]\0[n-l}) 

p— >o 






/<0[n]) 


- h(0[n}) = 



(63) 

where (a) comes from the fact that h(0[n]) is not a function of p, (b) comes from the relation = 
H0[n]\0[n — 1]) in (O; (c) from the distribution equality in (list , we know that as p goes to zero, 7 goes to 
infinity. Thus 6i[n] becomes independent to 9i[n — 1] when we consider the last equality in 1161 . 

V. Discussion and Numerical Results 

A. Comparison of Entropies 

In Fig. |3] continuous and discrete entropies of the phase steering and tracking values are compared. Simulation 
results for the discrete entropies are obtained via Monte-Carlo simulation. Both of the phase steering and tracking 
values are uniformly quantized to L = 128 levels. Corresponding simulation results for the continuous entropies are 
transformed by using the relation h(X) w H(X^) + log 2 The results show that the continuous and discrete 
entropies of the phase tracking value are monotonic increasing functions of the NDF while the ones of the phase 
steering value are constant. 
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In Fig. [3a] the derived curves of continuous entropies for the phase steering and tracking values are compared to 
the simulation results. In the case of phase steering values, the simulation result is exactly matched to the continuous 
entropy log 2 27r in Theorem 1. In the case of phase tracking value, the results of analytical upperbound in Theorems 
2, 3, 4, and 5 are jointly plotted. The von-Mises upperbounds in Theorem 4 and Theorem 5 are more accurate than 
the ones for the Gaussian upperbound in Theorem 2 and Theorem 3. Note that the upperbounds in Theorem 3 and 
Theorem 5 are closed-form expressions which are relatively looser than the corresponding numerical upperbounds in 
Theorem 2 and Theorem 4. For high NDF regions, the gap between the von-Mises upperbounds and the simulation 
result approaches to zero while the Gaussian upperbounds and the simulation result has constant gap as mentioned 
in Section III-C. 

In Fig. [3b] discrete entropies of the phase tracking vector normalized by the number of tracking values in 

_f/e (i '[n]) 

the vector, i.e., N 1 , are depicted for L = 32, 64, and 128. As L (the number of element-wise uniform 
quantization levels) increases, the required amount of feedback overhead also increases since information loss 
caused by quantization decreases. The von-Mises closed-form upperbound in Theorem 4 is plotted which is the 
most tight one with the simulation result among the four upperbounds presented above. The correlation between 
elements in the phase tracking vector can be verified in this figure by inspecting the gap between simulation results 
for Nt — 2 and Nt = 3. The gap represents normalized MI between elements in the phase tracking vector , i.e., 
-f(eiW,e 2 N) ^ wn j cn j s n0 ( zero though it seems negligibly small. Note that the upperbound is tight to the simulation 
results both for sufficiently slow-varying and fast-varying channels. 
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Fig. 4. Applications (a) Phase tracking codebook outperforms phase steering codebook with smaller number of feedback overheads (b) 
Determination of feedback duration in the sense that MI between adjacent feedback slots should larger than certain threshold r\ 



B. Applications 

1 ) Phase Tracking Codebook: We construct phase steering and tracking codebooks to evaluate the average SNR 
performance w.r.t. the amount of feedback overhead. The phase steering codebook is simply generated by element- 
wise L-level uniform quantization to the phase steering vector. Hence (Nt — 1) log 2 L becomes the feedback 
overhead of the phase steering codebook. The phase tracking codebook is generated via generalized Lloyd type 
vector quantization (VQ) technique |34*1 . Letting the size of the codebook be T, the feedback overhead of the 
phase tracking codebook becomes log 2 T. The simulated average SNR results are depicted in Fig. |4a] Unlike the 
phase steering codebook, the performance of the tracking codebook is a function of Jm which improves more as 
the NDF become smaller. The entropy of the phase tracking vector decreases for small /at, and thus the phase 
tracking codebook can convey more information of feedback messages as NDF become smaller though the amount 
of feedback overhead remains constant. As shown in Fig. [4a] the phase tracking codebook can outperform the phase 
steering codebook even when the amount of feedback information bit is significantly smaller when the degree of 
channel variation is sufficiently small. 

2) Influence to the Feedback Duration: Let I(6[n];9[n — 1]) = r]h{6[n]) where j] E [0, 1] is the threshold of 
remainder information of phase steering values at the transmitter after the duration of feedback slots r. This also 
can be represented as 

h(e[n]) = (1 - rfiKOW) 

= {l-r])(N T -l)log 2 2TT. (64) 
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Now to determine the appropriate feedback duration, firstly p should be found which satisfies d64l i. Then by using 
p and the relation in (0, we can obtain Jm and corresponding f = Jn/Id- Note that f represents the appropriate 
duration of feedback slots which guarantees the quality of the outdated feedback messages. In Fig. 0b] the appropriate 
feedback duration f is depicted for rj = 0.1, 0.25, and 0.5 w.r.t. the maximum Doppler frequency fjj, where instead 
of using h(e[n]) in ( f64-b the closed-form von-Mises upperbound in Theorem 5 is used. As r increases the appropriate 
duration f decreases since the required amount of the remainder information in the outdated feedback messages 
also increases. The appropriate duration f also decreases as the maximum Doppler frequency fry increases since 
the temporal correlation parameter p and corresponding h(e[n]) also become small. 

VI. Conclusion 

The feedback overhead for MIMO beamforming is analyzed considering temporal correlation property of the 
wireless fading channels. Under PAPC, two types of feedback messages, the phase steering and tracking values, 
are investigated and the corresponding entropies are derived in the functions of temporal correlation parameter. For 
the phase steering value, the i.i.d. property is proved in Theorem 1. For the phase tracking values, four upperbound 
entropies are derived based on the Gaussian PDF and von-Mises PDF in Theorem 2 - Theorems 5 where two 
of them in Theorems 3, 5 are closed-form expressions. The derived results can represent the amount of required 
bits for each type of feedback message via rate-limited feedback links and also show the amount of reduction 
in feedback overhead obtained from taking temporal correlation property into account for encoding of feedback 
messages. For application perspective, the phase tracking codebook generated by VQ algorithm is proposed which 
can outperform the phase steering codebook with smaller number of feedback bits. Also the derived results can 
be used to determine the appropriate duration of feedback report with the function of the threshold of remainder 
information at transmitter and the maximum Doppler frequency. 

Appendix 

A. Relation between the Continuous Entropy of the von-Mises PDF and the Corresponding MRL 

The continuous entropy of von-Mises PDF is inversely proportional to the corresponding MRL. It is directly 
proved from following two Remarks. 

Remark 1: The MRL of von-Mises PDF R = i 1 ,*, is a monotonic increasing function w.r.t. the concentration 
parameter k. 

Proof: Let the ratio of two modifided Bessel functions of the first kind be denoted by 

r„(») = ^ (65) 

for v > 0. Then the ratio can be rewritten as 

x 

r v (x) = r . (66) 

v + 1 + (R u+1 x 2 + (y + l) 2 ) 5 
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where R u +x = r v +i/r v (32). Note that < R u +\ < 1 holds since < r v+ i(x) < r u (x) < 1 is satisfied 
Taking derivative to the ratio, we derive 

-^—r,j{x) = 5 5 ■ (67) 

& i + + ^(1 + y) 2 + Ru+xx* 

Since v > and < R u +i < 1, the derivative -4-r v {x) is always positive regardless of the value of v. ■ 
Remark 2: The continuous entropy of von-Mises PDF is a monotonic decreasing function w.r.t. the concentration 
parameter k. 

Proof: By using d65l ). the continuous entropy of von-Mises PDF in (f2TT > is rewritten as 



h(V) = -Kr (/e) log 2 e + bg a (27r/ (K)). (68) 



Differentiating w.r.t. k, we obtain 



^h{V) = -r (/s) log 2 e - ki> [k) log 2 e + log 2 e. (69) 
an loyK) 



By using the facts that I' v (x)/I v (x) — r„(x) + vjx and < r' v (x) in 1321 . we derive 

-j-h(V) = (-r («) - kt ( k ) + r (/c)) log 2 e 
= -Kro(K)log 2 e < 0. 

B. Proof of Lemma \3\ 

For the range of < 7 < 1, the conditional expectation C(pf) is lowerbounded as 



c.(7) = ^ r , i+7cos ^ # 

2?r '-7T \/ 1 + 7 2 + 27 cos 



> j_ r (i + 7 cos^) 2 

(V, 2tt 7_ w 1 + 7 2 + 27 cos V» 



= 1 _J_ r 7 2 sin 2 ^ 

2tt 7_ 7r 1 + 7 2 + 27 cos ^ 

2 

= C £l ( 7 ) (70) 
where 1+7 cos -0 < x holds f or q < 7 < l due to (1 + 7 cos ip) 2 < 1 + 7 2 + 27COS?/>, and (a) follows from 

Y l+7 2 +27 cos tp 

the fact that a; 2 < x holds for < x < 1. 
For the range of 7 > 1, 

a(7) = ^ r , i+7cos ^ 

2tt y/l + 7 2 + 27 cos ?/> 
1 1 + 7 cost/; 



(a) 7T Jq y/l + 7 2 + 27008^ 

If* l + 7 co S ^ 1 r 1 + 700,^ 



(*>) T Jo v 7 ! + 7 2 + 27 cos ^ ^ A&r \A + 7 2 + 27003^ 
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where (a) follows from the fact that cos(x) = cos(— x) and ipT in (b) satisfies 7Cos^t = — 1- Since 1 + 7COS1/' 
has a positive value when i/> € [0, tpr) and a negative value when ip G [ipT,^], the £^(7) is lowerbounded as 

cm > - [" T ] + ^ # + i f / 1 + 7COS ^ # 

V '-kJo Vl + 7 2 + 2 7 ^1+72-27 
V't + 7 s m "0T ^ — (V't + 7 sin ^>t) 

(72) 



7r(7 + 1) ' 7r(7 — 1) 

1 2(V>t + 7sin-0T) 



(7-1) 7t( 7 +1)(7-1)' 
Since 7COS-0T = — 1, we have cos 2 i/jt — I/7 2 and sin 2 i/jt = 1 — I/7 2 to satisfy sin 2 ipx + cos 2 i/jt = 1. Thus 
7 2 sin 2 = 7 2 — 1 is obtained. Further since positiveness of j 2 sin 2 i/>t is guaranteed for i/>t € [0, 7r], the equality 



jsvaipr = -\/7 2 — 1 holds. Hence d72l can be written as 

Ce(7) - eFi) " ^(7+i)(7-i) " 7^7^' ( } 

Also since jcostpx = — 1, we have cos(7r — -0t) = 1/7- By using the trigonometry identities, tan(7r — tpx) = 7 2 — 1 
is obtained, and thus tpr = tt — tan _1 (7 2 — 1) can be derived. Hence (|73T > can be rewritten as 

1 2(tt - tan- 1 ( 7 2 - 1)) 2 



C« (7) > 



(7-1) 7r( 7 + l)(7-l) ^v/t^T 
1 2 tan" 1 ^/i 1 - 1 -2 



(7 + 1) 7r(7 + l)(7-l) ttv/t^T 
"C i2 ( 7 ) (74) 

C. Proof for Non-negativeness of Ci(k) in ( 1371 ) 

Firstly, Ci(fc) > directly follows from the fact that Cl 1 (j) > for < 7 < 1. Secondly, Oz(k) > is proved 
by showing that Cl 2 (x) > due to the definition 02(h) — CL 2 {x)f 1 (x)dx in ( f3TT ). Note that 



^2(7) " 



(7 + 1) 7r(7 + l)( 7 -l) tt/t^ 
1 l 6 ^7 2 - 1 ^ -2 



(a) (7+1) 7r(7 + l)(7-l)(l + 2 7 ) tt^T^T 

= ^^7^(7 - 1)(1 + 2 7 ) ~ 4(7 + 1)( 7 - I) 2 a e M (75) 
7rv /^23i( 7 _i)( 7 + i)(i + 2 7 ) 

where (a) follows from the inequality tan _1 (a;) > 1+2 ^/i+x 2 ' n ^3" Since me numerator of C a {j) is greater or 
equal to zero for 7 > 1, we need to show that the denominator of C a (^f) is also greater or equal to zero for the 
same range of 7. The denominator of C a (j) is lowerbounded by 77(7 — 1) 2 (1 + 27) — 4(7 + 1)(7 — l) 2 = C&(:r) 



since the inequality y/j 2 — 1 > 7 — 1 holds for 7 > 1. Differentiating £5(7) w.r.t. 7, we obtain ■j-Cb('j) = 
6(7r - 1)7 2 - 2(37r - 4)7 + 4 which has two roots at 7 = 1 and 7 = 3 /^_ 2 \ . Since Cb(a;) = 2(7r - 2)7 3 + 0(7 2 ) 
and 2(ir — 2) > 0, the local minimum of Ch(7) occurs at 7 = 1 and 6*6(7) > Cfc(l) = for all 7 > 1. Thus the 
positiveness of C a (^) is guaranteed since the denominator of C a (^) is lowerbounded by Cf>(7) > 0. 
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